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feasibility of using expert opinion to develop a comprehen- 
Sive oral health index, is presented. 
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The major conclusion of this thesis) is that no existing 
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ZL. , LNTRODUECTEON 


As the costs of health care continue to spiral ever upward, 
the public has begun to ask questions, and through its elected 
representatives, demand answers, about health care in the 
United States. This has been particularly true~in “the pubes 
sector, including the uniformed military services, where health 
care is financed through collection of taxes and creation of 
public debt. 

The public is beginning to demand accountability for 
government's use of budgetary assets. The who, what, when, 
where, and how of publicly financed health care services is 
being questioned at virtually every level of government. 

The answers to many of these questions have been legislated 
cheousn our system of laws and regulations. [Ref. 1-2] Others 
come from currently accepted professional practices, current 
technology, and the availability of resources. Some seem eee 
have no generally accepted answers, a fact that is a bother- 
some and multifaceted problem in itself. 

First, because of the highly qualitative and multidimen- 
sional nature of health care, there has been little agreement 
On an operational definition of health. An acceptable 
definition of health would have to reflect social preferences 
toward various functional levels: social, mental, and physical; 


the relative importance of diseases and disabilities; the 
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likelihood of occurrence of different diseases and disabili- 
ties; and the prognosis associated with each disease and 
disability. [Ref. 3] Concurrence, even on these facets, has 
been difficult to achieve. 

Second, because health is multidimensional, it cannot be 
actually measured, only inferred. Specific components of 
health, once identified, must be defined, measured to the 
extent possible, and relative weights, representing social 
and clinical values, assigned. These separate components of 
health may be considered as individual indicators of health 
and combined to form an index of general health status. Once 
an index of health status has been conceptualized, developed, 
and operationalized, it may be used to indicate relative levels 
of health in both individuals and populations; serve as a 
measure of the effectiveness of health care systems; and 
serve as a single component of individual measures of 
aeceountability, efficiency, effectiveness, productivity, 
quality, etc. [Ref. 4-6] 

Neither of these two major issues are easily resolved, 
Mewever, and a fair body of literature now exists discussing 
conceptual and methodological problems inherent in the 
deve lopment and use of health status indexes. Two major 
problems that seem to be pervasive throughout the literature 
teaemcne tendency tO conceptualize health in all encompassing 
definitions, making measurement difficult; and the tendency 


to try and develop mathematical formulas and models which 


is 


will capture all components of health, yet are so complex 
they are rendered unusable for most practitioners and 
managers. [Ref. 7-11] 

These problems, however, have not deterred researchers, 
practitioners ,+and-decision makers, particularly wtentn seme 
public health sector, from searching for such measures. 

This thesis represents” a further attempt to E£ind and 
evaluate a health status index, primarily for oral health, 
for use within the naval health care arena, capable of 
meeting the needs of clinicians, administrators, and public 
decision makers alike. 

The first step~in this‘ attempt to find a surtable eras 
health index was an examination of past research and clinical 
practices’ through ~a~revrew of~reléevanterrterature. ee mees 
review of pertinent literature provides the substance of the 


following chapter. 
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i It. LITERATURE REVIEW 


As can be seen from the bibliography, there is a wealth 
of literature available pertaining to health indexes. To 
provide some semblance of order in reviewing the literature, 
indexes directed primarily toward general health issues will 
be discussed first, followed by a survey of a wide range of 
indexes pertaining to oral health, a review of a number of 
more popular and widely accepted oral health indexes, and 
an examination of recent developments regarding oral health 


indexes. 


A. GENERAL HEALTH INDEXES 

General health indexes of a wide variety have been 
proposed to measure an individual's social and ahysites 
well-being [Ref. 12-13]; the overall health status of 
communities and general populations [Ref. 14-17]; implications 
and importance of various social and sociomedical factors in 
health care [Ref. 18-20]; unmet health care needs of individ- 
uals and populations [Ref. 21-22]; society's values and 
Genlatres Of varvtous conditions of Life [Ref. 23-24]; quality 
of health care services and outcomes of health care interven- 
trons ~|Ref. “25-27]|'+/ priorities of health care programs in 
society and governmental agencies [Ref. 28]; effectiveness 
of health care programs in achieving desirable health care 


outcomes [Ref. 29-35]; utilization and resource allocation in 
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providing health care services and achieving desired health 
care outcomes [Ref. 36-37]; clinical, technological, social 
political, and economic indicators for health care policy and 
research [Ref. 38]; clinical, technological, social, political, 
and economic indicators for health care planning [Ref. 39-41]; 
morbidity and mortality [Ref. 42]; patient's preferences in 


obtaining health care services and achieving health care 


outcomes [Ref. 43]; impact of sickness on individuals, groups, 
and populations [Ref. 44-47]; seriousness of illness and its 
consequences, clinical as well as social [Ref. 48-49]; dis- 


ability and its consequences, for individuals as well as 
society [Ref. 50-52]; illness in the aged and its consequences, 
for individuals as well as society [Ref. 53]; and comprehen- 
sive health measures indicating specific health states 
[Ref.°54].. 

As can be seen above, a great deal of time and effort has 
been expended in attempts to develop a wide variety of general 
health status indexes. The vast majority of these indexes 
have been developed for special purposes, however, and are 
generally valid only under specific cireumstances. Noenewae 
them are universally accepted as general health status indexes, 
nor are they useful under the wide range of conditions and 
situations of interest to public health decision makers: 

This situation is no less problematic within the dental 


health sector, the, area of principal concern for thio enemas 
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B. GENERAL ORAL HEALTH INDEXES 

As with indexes developed for evaluating general health 
states, eevee amount of literature is available regarding 
the development and utilization of indexes for a variety of 
conditions and situations relating to oral health. 

There are general oral health indexes developed for a wide 
range of epidemiological studies to examine the prevalence and 
incidence of oral disease and the oral health status of 
communities and populations [Ref. 55-60]; social and socio- 
dental factors associated with oral health of individuals and 
populations, particularly as related to influences of cultural 
and ecological factors [Ref. 61-63]; unmet dental health needs 
of individuals and populations in a variety of social and 
economic situations [Ref. 64-73]; dental health status and 
general satisfaction with specific dental conditions [Ref. 
74]; outcomes, appropriateness, and quality of oral health 
care services provided [Ref. 75-88]; efficiency and produc- 
tivity of dental health services [Ref. 89-91]; anxiety related 
to dental health care [Ref. 92]; and the needs of special 


populations such as the elderly and the military [Ref. 93-110]. 


ee SPECIFIC ORAL HEALTH “INDEXES 

In addition to the general oral health indexes, there 
are a number of more specific oral health indexes that relate 
Bermarily tO specific oral structures and tissues, clinical 
conditions, and diagnostic methodologies. There are indexes 


developed primarily for measurement of levels of oral hygiene 


iz 


[Ref. 111-120]; the amount of soft accumulations, plaques, 
stains, and debris on dental structures [Ref. 121]; the amount 
of hard deposits and calculus on dental structures [Ref. 122- 
124]; the clinical condition, relative health, and pathologic 
states of the gingival structures [Ref. 125-135]; the number 
of carious lesions and decayed teeth [Ref. 136-153]; severity, 
incidence, prevalence, and consequences of periodontal disease 
[Ref. 154-199]; the degree of alveolar bone loss secondary to 
periodontal disease, as measured by periodontal pocket depth, 
radiographic analysis, and surgical determination [Ref. 200- 
205]; the assessment of tooth mobility secondary to periodontal 
disease and alveolar Hore loss [Ref. 206]; the loss of teeth 
secondary to disease and injury [Ref. 207]; the identification 
and scoring of occlusal disorders [Ref. 208-210]; the identi- 
fication of dental structures potentially requiring endodontic 
intervention [Ref. 211-212]; the identification of need, 
prioritization, and outcomes of orthodontic treatment [Ref. 
213-214]; the use of radiographic methodologies in clinical 
diagnosis, prognosis, and follow-up of oral’ disease; tngjueys 
and treatment outcomes [Ref. 215-220]; and the use of complex 
mathematical, statistical, and computerized models to predict, 
evaluate, and monitor the need for clinical services, the 
outcome of dental intervention, and econometric measures of 


productivity [Ref. 221-230). 
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D. WIDELY KNOWN ORAL HEALTH INDEXES 

A number of these indexes have been generally accepted, 
although SESH in only very restricted situations, and have 
been used in a wide variety of epidemiological studies: 

1. The DMF Index 

The DMF (Decayed, Missing, or Filled) index, developed 
by Klein, Palmer, and Knutson, while studying the dental needs 
of elementary school children in Hagerstown, Maryland, during 
the late 1930's, provided the first and perhaps best known and 
most widely accepted, of the oral health indexes. [Ref. 231- 
234] 

The DMF index is based on ascertaining the number of 
teeth which are carious, missing, or restored (filled). The 
index has been reported in at least two different methodolo- 
gies. First, the DMF index may be reported as the average 
number of DMF teeth per person examined. This is sometimes 
referred to as the DMFT (decayed, missing, or filled teeth) 
index. And, second, the DMF index may be reported as the 
average number of DMF tooth surfaces per person examined. 

This is sometimes referred to as the DMFS (decayed, missing, 
or filled surfaces) index. [Ref. 235] 
2. The PMA Index 

The PMA (Papillary gingivae, Marginal gingivae, and 
Peeached gingivae) .index, developed by Schour, and: Massler 
during the late 1940's, represented an attempt to provide a 
GUantitative method,of recording inflammatory changes in the 


gingivae. [Ref. 236-243] 
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The index is obtained by assessing the prevalence and 
severity of gingivitis and assigning numerical scores for 
each of three gingival areas for each tooth examined: the 
papillary gingivae, the marginal gingivae, and the attached 
gingivae. A score is established for each tooth and summed 
to provide a PMA index for an individual's mouth. Scores 
obtained for individuals may be summed and averaged to provide 
an epidemiological index for communities and populations. 
[Ref. 244] 
3. Russell's Periodontal Index 

The periodontal index developed by Russell during the 
1950's represented the first major attempt to provide a measure 
of periodontal disease for epidemiological studies. [Ref. 245- 
248] 

Fach tooth examined is evaluated for clinical signs 
of periodontitis, particularly noting the usual progressive 
nature of the disease, inflammation of the gingivae followed 
by periodontal pocket formation and eventual loss of mastica- 
tory function. . Each tooth is, assigned a numerical score ere 
scores are summed for all teeth examined, and the total score 
is divided by the number of steeth examined... This, average 


score represents the average conditions of the periodontal 


tissues and structures within a patient's mouth. [Ref. 249] 
4. Ramfjord's Periodontal Index 


The periodontal index, developed by Ramfjord during 


the late 1950's, represented another attempt to provide a 
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measure of periodontal disease for use in epidemiological 
studies. [Ref. 250-251] 

The index is accomplished by conducting a thorough 
examination of the periodontal status of six teeth, parti- 
cularly noting the condition of the gingivae, periodontal 
pocket depth, calculus and plaque deposits, attrition, 
Mobility, and!) Lack) of contact. [Refs 252] 

5. Gingival-Bone Count 

The gingival-bone count, developed by Dunning and 
Leach during the late 1950's, represented another attempt 
to provide a measure of periodontal disease for use in 
epidemiological studies. Of particular interest to the 
developers was the ability of an index to reflect both 
reversible signs of periodontal disease, primarily gingival 
changes, and irreversible sequelae of periodontal disease, 
Beamearily, alveolar bone.loss.. ,[Ref.. 253] 

The gingival-bone count is obtained by assessing the 
gingival status and bone loss of each tooth examined, a 
numerical score assigned for each tooth by combining the 
individual gingival scores and bone scores, and an average 
computed for the whole mouth. [Ref. 254] 

6. Oral.Hygiene Index,.(OHI) 

The oral hygiene index, developed by Green and 
Vermillion during the late 1950's, and subsequently modified 
to provide the simplified oral hygiene index (OHI-S), repre- 


sented a further attempt to provide a measure of periodontal 
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Bisetse for use in a wide range of epidemiological studies. 
[Ref. 255-257] 

The oral hygiene index is actually a combination of 
two separate indexes, the debris index and the calculus index. 
The debris index is obtained by evaluating the amount of debris 
on each of six preselected tooth surfaces and assigning a 
numerical score for each tooth. The individual tooth scores 
are summed and the total divided by the number of teeth 
examined. The calculus index is obtained similarly, 
evaluating each of the teeth for the presence of calculus. 

The oral hygiene index is then obtained by summing the debris 
index and the calculus index. [Ref. 258] 


7. Gingival Index, Plaque Index, and Retention Index 


System 


The gingival index, plaque index, and the retention 
index, developed by Loe and Silness in the early 1960's, 
represented another approach to the evaluation of periodontal 
disease epidemiology. [Refs. 259-260] 

The three indexes actually comprise a system for 
evaluating the clinical consequences of periodontal disease. 
[Ref. 261] 

The gingival index is entirely confined to the 
qualitative changes in the soft tissues of the gingivae. 
Each of four gingival areas of each tooth examined is 
assigned a numerical score, based upon clinical changes in 
the tissue, indicative of the degree of gingivitis present. 


The scores for the four areas are summed and divided by four 
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to obtain a gingival index for each tooth. The scores for 
each tooth are then summed and the total divided by the 
number of teeth examined to obtain a gingival index for the 
individual. [Ref. 261: pp. 610-613] 

The plaque index is confined to an evaluation of the 
amount of soft debris (plaque) which has accumulated on each 
of the four gingival areas previously evaluated for the 
gingival index. Each of the four gingival areas of each 
tooth examined is assigned a numerical score, based upon the 
amount of soft debris present. The plaque index is then 
calculated similarly to the gingival index. [Ref. 261: 
pp. 613-614] 

The retention index is based upon an evaluation of 
the degree of rough surfaces, such as caries, calculus, and 
imperfect restorations, available for accumulation (retention) 
of bacteria, which promote gingival disease, on each tooth 
previously evaluated for the gingival and plaque indexes. 

A numerical score is established for each tooth and the final 
Betention index is calculated similarly to the gingival and 
plaque indexes. [Ref. 261: p. 614] 

eae Calculus Surface Index 

The calculus surface index, developed by Ennerver, 
Sturzenberger, and Radike during the late 1950's, was an 
@eceompt tO provide a scoring system for quantitating the 
accumulation o£ dental calculus in short-term testing 


programs. [Ref. 262] 
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Each of the mandibular incisors is considered on 
the basis of four surfaces, two proximals, one labial and 
one lingual. Upon examination, the number of tooth surfaces 
on which calculus had occurred is noted, and a numerical 
score, zero to four indicating the number of tooth surfaces 
involved, assigned. The totals for each tooth are summed. 

The calculus surface index is then the total number of tooth 
surfaces on which calculus had been detected. [Ref. 262: 
Ds. 54) 

9. Navy Periodontal Screening Examination 

The Navy periodontal screening examination was 
implemented in 1968 to increase dentists" awareness of 
periodontal pathology, emphasize the importance of early 
diagnosis and treatment, and provide a tool for assessing 
patients' abilities and motivation for practicing health 
maintenance activities. [Refs. 263-268] 

The Navy periodontal screening examination is com- 
prised of two separate indexes: the Navy periodontal disease 
index and the Navy plaque index. Both indexes are conducted 
on six teeth, the same teeth as used in Ramfjord's periodontal 
imvdex.©" (Ret. 2632 so. 42) 

The Navy periodontal disease index (NPDI) is comprised 
of two separate parts as well: a gingival score which assesses 
gingival inflammation, as manifest by color, consistency, Gems 
sity, enlargement, and bleeding tendencies, and a periodontal 


pocket score which assesses alveolar bone destruction as 
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determined by periodontal pocket depth. Combining these 

two scores provides the .NeOEr «scone for, the pindividual tooth: 
The results are recorded in the patient's clinical record as 
the NPDI score (the highest score obtained for any individual 
tooth) and the NPDI total for the six teeth examined. [Ref. 
2e4: Dp. 363] 

The Navy plaque index (NPI) reflects the plaque 
control status of the individual, emphasizing bacterial 
plaque present on the cervical area of the tooth, in contact 
With the gingival margins, felt to be of greatest, concern.in 
Bertzocontal disease. _ the results. are, recorded, an: the, patszent's 
clinical record as the NPI score (the highest score obtained 
for any individual tooth) and the NPI total for the six teeth 


examined. [Ref. 264: p. 63] 


E. RECENT ADVANCES 

These oral health indexes have been evaluated extensively 
in the literature. [Refs. 269-282] Many of the indexes, 
particularly those specific oral health indexes discussed 
above, have shown acceptance in specific and limited uses, 
Gemerally those for which, the indexes were initially devel- 
Oped. As with the general health status indexes, however, 
there has been no universal acceptance of the use or value 
of the oral health indexes, particularly within the wide 
range of contexts of interest to clinicians, researchers, 


and decision makers. 
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A major step in the search for a comprehensive oral 
health status measure was accomplished by Nikias, Sollecito, 
and Fink in the late 1970's. [Refs. 283-284] 

In evaluating the many oral health status indexes in 
use, they noted that none of the measures, when employed 
separately, produced a reasonably accurate picture of total 
Oral health. The need for one comprehensive index, capable 
of depicting all potentially significant disease processes, 
their interactions, and their consequences, was Clearly 
stressed. They noted that, in addition to being able to 
summarize diverse clinical elements into one index, a com- 
prehensive oral health index should provide a meaningful 
concept of oral health status, expressed numerically, which 
would provide a statistical tool for use’ by clinverans, 
researchers, and decision makers alike, in a diverse range 
of situations. [Refs 283. pe 4s] 

Using data gathered from the examination of 1,290 adult 
members of the Health Insurance Plan of Greater New York 
(HIP) (a prepaid medical group practice), Nikias and her 
coworkers developed composite profiles of oral health status 
composed of specific clinical oral conditions. Hight clinges 


oral conditions were initially analyzed for inclusion ina 


comprehensive profile of oral health status: (1) edentulous- 
ness (in both arches, or in one arch); (2) number Of isSeee 
and unreplaced teeth; (3) levels of disease in gingival and 
periodontal tissues; (4) percent of decayed teeth; (5) oral 
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hygiene status; (6) number of healthy and untreated teeth; 
(7) number of filled teeth; and (8) number of replaced teeth. 
[Ref. 283: p. 150] These were subsequently reduced to four 
dimensions, with four levels of clinical severity in each: 
(1) missing teeth; (2) disease in gingival and periodontal 
tissues; (3) decayed teeth; and (4) oral hygiene status. 
bRes. 1283; p. 152] 

ihiesprincipal slinding Of ,tnis, anitial work was that it 
appeared feasible to combine multiple oral diseases and 
conditions to provide a comprehensive measure of oral health 
status. It was felt that this comprehensive measure, once 
developed, would facilitate epidemiological comparisons or 
Oral health status among populations, assessment of changes 
in oral health status over time, evaluation and planning of 
Oral health programs, and meeting oral health needs of 
populations of interest. [Ref. 283: p. 158] 

After accomplishing the construction of comprehensive 
profiles of oral health status, Nikias and her coworkers 
Book. the next major step, that of attempting to combine the 
comprehensive profiles into one composite oral health index. 
The problem of just how to rank these comprehensive profiles 
in regard to relative oral health states was now addressed. 
The question to be answered, in considering only two patients 
for example, was that of, “which patient was in a.better 
state of oral health, one which was missing several teeth but 


has no gingival or periodontal disease, or one who has all 
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teeth present but has significant gingival and periodontal 
disease?" Although a number of scaling procedures could 

have been used, they decided upon attempting to use the 
judgments of dental health professionals, combined with a 
modified version of the equal appearing intervals method of 
scaling, to provide relative rankings and subsequent develop- 
ment of a composite oral health index. [Ref. 284: p. 17] 

Twenty-nine dentists, representing four broad categories 
of practitioners, were selected for participation anes 
final ranking. Six of the dentists were from private 
practices, nine were from research-oriented situations, nine 
were from public health practice, and five of the dentists 
combined private practices with part-time teaching or research 
positions ..\; [Refer 284 -o peed? 

Forty-two profiles, each composed of four clinical condi- 
tions: (1) number of missing and unreplaced teeth (divided 
into four levels of severity); (2) periodontal disease 
(divided inte fours levels of severity); (3) decayees eacem 
(divided into two levels of severity); and (4) oral hygiene 
(divided into two levels of severity). Each of the twenty- 
nine dentists was sent a package containing study background 
information, a set of forty-two randomly ordered computer 
punch cards (each card contained a punched and printed 
description of an oral health status profile), and detailed 


instructions on how to rank the profiles from best to worse 
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Using an integer scale from one to nine. The ranking by 
oral health status was accomplished by sorting the forty-two 
computer punch cards into nine piles, representing the nine 
levels of oral health indicated by the integer scale of one 
to nine. These piles were then subsequently ranked to pro- 
vide a relative ranking within each of the nine initial 
profiles. In the end, the forty-two computer punch cards, 
representing the forty-two clinical oral health profiles, 
would be ordered into a ranking such that each successive 
card or case would be in poorer oral health than the card 

OF Case preceding it. [Ref. 284: p. 17] The results of the 
individual dentist's rankings were then averaged and the 
means used to provide a "summary statistic" or "oral health 
gndex” oot [| Ref. (284: «pp JoL7=18] 

In their conclusion, Nikias and her coworkers noted four 
major findings from their studies: (1) Developing a compre- 
hensive oral health index based upon professional concensus 
appears feasible. (2) Dentist's vary considerably in their 
assessment of clinical oral health states. This variation 
cannot simply be explained by professional orientations and 
activities, but seems to be subjective and varies according 
nemeherindividual jocln fact detailed analysis’ of the actual 
rankings of the oral health profiles revealed that there was 
as much or more variation within each professional group as 
between groups. The greatest variability is in oral health 


states that have a combination of contrasting levels of oral 
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disease and conditions. (3) Of the four conditions that 

made up the forty-two oral health profiles, number of missing 
and unreplaced teeth and levels of periodontal disease were 
found to be most highly correlated with the final ranking and 
Oral health index. (4) Based upon work accomplished to present, 
it seems difficult to devise an all-purpose oral health index. 
[Ref. 284: pp. 21-25] 

The work of Nikias and her coworkers provided an impetus 
for new directions in research and development of oral health 
indexes. These new directions, largely represented by the 
subsequent work of Marcus and his coworkers [Refs. 285-293], 
related to the use of specific statistical methodologies, 
principally the preference pairs methodology of Mickey and 
Britt [Ref. 295], to derive oral health status indexes 
reflective of opinions and preferences Of Expert Genmreae 
health professionals. It is this work which is examined 


in the followzang chapeex. 
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aa fTT. ORAL HEALTH STATUS INDEX 


A major shift in the search for a comprehensive oral 
health status index occurred during the late 1970's. After 
conducting an exhaustive search for a comprehensive oral 
health index which would satisfy the requirements of clini- 
cians, researchers, decision makers, and other interested 
parties alike, Marcus and his coworkers felt that no such 
measure currently existed. Consequently, they embarked ona 
research program of several years duration in an attempt to 
develop such a comprehensive measure. [Refs. 285-293] 

The stated aims of this research were threefold. 

First, to develop comprehensive, integrated oral health 
status measures for both adult and pediatric populations, 
primarily for monitoring both groups to evaluate the outcome 
of oral health care services. [Ref. 285: p. 3] 

Second, to develop measures of oral health status 
Characterizing populations rather than individuals; 
empirically derive significant factors in the concept of 
Oral health based upon opinions of experts (dentists) ; 
incorporate both positive factors associated with oral 
health and negative factors associated with oral pathology; 
establish quantifiable measures of oral health which permit 
Statistical analysis of populations; ensure that any index 


developed is sensitive to changes in oral health status; 
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and ensure that any index developed will hold practical 
relevance for a wide range of potential users of the index, 
particularly dental practitioners, health care administrators, 
and the public: -[Refs 2953 "ps1 

Third, to utilize a methodology which will ensure the 
reliability and validity of the measures used to develop the 
index. [Ref. 2852" pp. 3=4| 

Marcus and his coworkers developed a set of 232 clinical 
cases for use in their research. Each case consisted of a 
brief patient description, including a brief medical and 
dental history; color slides of facial profiles and intrageam 
appearances; a set of radiographs, including periapicals, 
bitewings, and a panorex; a set of complete plaster mouth 
study casts; and a completed dental chart. [Ref. 287: p. 335] 

A panel of twelve general dentists was selected to provide 
the expert opinions needed during the experimentation and 
development phase of the research program. The consultants 
for the panel were selected upon the following four criteria: 
(1) a minimum of five years of clinical experience; (2) past 
Or current experience in quality assessment and quality 
assurance activities; (3) representation from various 
geographic and demographic regions of the United States; 
and (4) clinical practice experience limited to general 
dentistry only.  [Ref. 285: 0p.) 301 

The methodology selected for the statistical "scaling" 


was the paired preference procedure described by Mickey and 
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Britt [Ref. 295] and available in the BMDP statistical 
package’! »_[Refs .. 296-297] 

The experiment was conducted by presenting the 232 
clinical cases, combined in 315 pairs of cases, to each 
of the twelve consultants. Each of the consultants selected 
which case of each pair of cases they considered to be in 
better oral health. Additionally, they were permitted to 
magi cate. signitcant idiffenences’ in) oral health;, af they 
existed. The results of this experiment provided the judg- 
ments needed for the statistical computation portion of the 
paired preference methodology. [Ref. 291: p. 286] 

Marcus and his coworkers initially used twenty-four 
variables, which were later reduced to eighteen variables, 
in the paired preference program. These included variables 
for certain health factors (diabetes, cardiovascular disorders, 
and rheumatic fever); temporomandibular joint (TMJ) dysfunc- 
Peons. (sounds , \dislocation, sfunctiiom«loss,, and pain),>,.occelu- 
sion/crossbite; tipped/extruded teeth; tooth abrasion; 
Eractured teeth; unerupted teeth; missing teeth; decayed 
teeth; filled teeth; restorations; endodontics, benign 
tumors (oral neoplasms such as fibromas, osteomas, tori, 
odontogenic cysts, and odontomas); replacements; calculus, 
mild periodontal disease (mild bone loss, periodontal 
pocket depth, and tooth mobility) ; moderate. periodontal 
disease (moderate bone loss, periodontal pocket depth, and 
tooth mobility); and severe periodontal disease (marked bone 
Pes ,ePOCket depth, and tooth mobility)... [Ref. 285:.p..,27] 
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To determine the most advantageous combination of 
variables and "subvariables", Marcus and his coworkers 
performed "nearly 100" regressions on six of the oral health 
variables deemed most significant after examination of 
initial results of the BMDP paired preference program: 

(1) mild periodontal disease; (2) moderate periodontal 
disease; (3) severe periodontal disease; (4) missing teeth; 
(5) decayed teeth; and (6) tumors. [Ref. 285: p. 73] 

Based upon the results of this initial attempt at index 
construction, the eight most promising variables obtained 
from the paired preference program were regressed against 
the judges' mean scores (from the initial BMDP paired 
preference programs using eighteen variables) in eleven 
different combinations of the variables, ranging from use 


of ‘only ‘four variables tovuse of akbrexrghty [she sergne 


variables used during this stage were: (1) mild periodontal 
disease; (2) moderate periodontal disease; (3) severe 
periodontal disease; (4) missing teeth; (5) decayed teeth; 


(6) tumors; (7) occlusion; and-»(8) replaced teeth. Upon 
examination of the results of thesceuagxesancnae Marcus and 
his coworkers reached a "strong concensus" on a model using 
five of the variables: (1) moderate periodontal disease; 
(2) severe periodontal disease; (3) missing teeth; (4) 
decayed teeth; and (5) replaced teeth. [Ref. 285: p. 78] 
Marcus and his coworkers felt that the five variables 


chosen above were "not amenable to measurement on a large 
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scale", and required modification. This was particularly 
true of the periodontal disease variables, which had included 
measures @f bone loss, periodontal pockets, and tooth mobility, 
and the missing teeth variable, which had included double 
counts of free ends, cuspids, and first molars. Further 
aMalysis revealed that: adding the»mumber .of free':ends',to the 
total number of missing teeth (excluding third molars) and 
using only severe and pulpal decay (excluding mild decay), 
seemed to provide a better fit (higher R-squared values) to 
the mean case scores (derived from the initial BMDP paired 
preference program using eighteen variables). Additionally, 
a decision was made to use only the periodontal pocket depth 
as the measure of periodontal disease. Thus, the final five 
variables selected for the direct adult oral health index 
included: (1) moderate periodontal disease (moderate 
periodontal pocket depth); (2) severe periodontal disease 
(marked periodontal pocket depth); (3) missing teeth and free 
ends; (4) decayed teeth (severe and pulpal decay); and (5) 
replaced teeth. [Ref. 285: pp. 78-79] 

The scores were subsequently scaled so that the maximum 
score (best case of oral health) would be 100 and the minimum 
score (edentulous case) would be zero. [Ref. 291: p. 288] 

The final beta coefficients (weights) for the five 
variables for the index were as follows: (1) missing teeth 
and free ends: -3.31; (2) replaced teeth: +0.61; (3) decayed 
teeth: -1.79; (4) periodontal pocket depth (4-6 mm): -0.73; 


pmemo) periodontal pocket depth (6+ mm): -3.02. [Ref. 292: p. 
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To use the oral health status index, the patient is 
examined and the results are entered on the direct oral health 
status index adult examination form in Figure l. Each tooth 
is marked as to whether it is missing (M), replaced (R), 
decayed (D), normal (N), or a space closure (C); the peri- 
odontal pockets are indicated at 4-6 mm and 6+ mm. The totals 
for each of the categories (missing, replaced, decayed, 4-6 mm 
pockets, and 6+ mm pockets) are placed in the # (total number) 
blank, multiplied by the appropriate beta coefficient (weight), 
the resulting products subtracted from 100, and the result 
placed in the blank for the final index. [Ref. 292: p. 732] 

The direct oral health status index, once ascertained, 
provides a measure of the overall oral health status of the 
individual examined, and when combined with other representa- 
tives of a population of interest, provides an epidemiological 
index useful in a wide range of health care activities, par 
ticularly administration, planning, quality assessment, and 
resicarch. 

The oral health status index developed by Marcus and his 
coworkers, of all the oral health indexes reviewed in the 
literature, appeared to provide the greatest potential for 
an oral health index within the health care system/lo£ the 
military services. ‘As such, ‘it provided the focal jpermme ex 
the majority of this current thesis effort contained within 


the following chapters. 
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DIRECT ORAL HEALTH STATUS INDEX 
ADULT EXAMINATION FORM 
0  ————— DATE: 


ho. EXAMINER: 


Tooth || Teeth Bone Loss 
* 4-6mm 6+m. 













BO-BmAvOYW 


LEGEND: 

M = missing 

R = replaced 

D = decayed 

N = normal 

C = space closure 
FE = free end 


IOD,Dy> BmvvCe 


RBO-BDMAWOY 





rIoD> zpmto0r 





zZO-BmMAWOD 











source: Marcus, Marvin; Gershen, Jay A.; Koch, Alma L.; 
and Snyder, Vera E. Oral Health Status Index User's Guide. 
Hes Angeles: University of California; 1980. 


Figure 1. Direct oral health status index adult 
examination form. 
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IV. ORAL HEALTH STATUS INDEX EVALUATION 


A. BACKGROUND 

After a thorough review of the literature -.vailable on 
Oral health incexes (see bibliography), the adult direct onau 
health status index developed by Marcus and his coworkers 
[Refs. 285-294] seemed to possess the greatest potential for 
the military health care system as an oral heaWihesotracne 
index. A number of questions concerning both its development 
and use were raised, however, and provided the impetus for 
Ens thesis. 

There were two “rimary objectives for this “thesis =:) | baa 
to verify the validity of the oral health status indéx Eheouwem 
examination._of 1ts development and construction... And seeemer 
to subsequently utilize methodologies and procedures similar 
to those used by Marcus and his” coworkers, particularily lea 
employed by Koch in her doctoral dissertation [Ref. 289], and 
apply them_to military dentists and heath care Sema =tema eae 
to verify the oral health Status index"s val sere, sore 
population servedwby, the,heailth,benefit.pregrams Of Ene 
uniformed services, in, pata coMery Eley Naw; 

As will be noted .:s the thesis progresses, stqntereage 
problems were encountered during evaluation of the ora: health 
status index. These problems made accomplishing the second 


thesis objective impractical. Consequently, the remarmneer 


of this thesis is largely devoted to verifying the validity 


of the index's development and construction. 


BS-'THE: ELRST ‘STEPS 

The researchers were able to spend several days at the 
University of California at Los Angeles (UCLA) dental school 
with Dr. Marvin Marcus, the driving force behind the oral 
health status index. During this time, Dr. Marcus provided 
a great deal of personal insight into the development, 
construction, and use of the oral health status index, as 
well as a wealth of information and data from his and his 
coworkers' initial work on the index. 

Dr. Marcus provided copies of all publications and 
articles produced during, and subsequent to, development of 
the oral health status index. More important, however, he 
provided computer printouts containing the initial, un- 
transformed data (not otherwise available) derived from the 
Smeginal) 237\.(only, 232 were actually used by Dr. Marcus and 
his coworkers) clinical dental cases used in development of 
the oral health status index. 

Perhaps even more important, Dr. Marcus provided quintes- 
sential insight into the processes involved in development of 
the oral health status index, his own concerns about using the 
index as planned by these researchers, and his own ideas for 
future directions and research for oral health status indexes. 

Based upon the available data and literature, as well as 


Dr. Marcus's insightful guidance, an initial plan was developed 
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to accomplish the two principal objectives of this thesis 
research, noted above. 

Due to time and logistical constraints, a decision was 
made to use only 66 of the initial 237 clinical cases in 
subsequent research within the naval health care community. 
These cases had been used in follow-on research by Marcus 
and Schoen in ascertaining the relationship between oral 
health status and dentists' preferences for treatment 
palnning [Ref. 298], and were considered representative of 
the initial 232 clinical cases used in development of the 
oral health status index. Using the 66 selected clinical 
cases and the original, untransformed data used in development 
of the oral health status index, the results of “Eurther 7e— 
search within the naval health care environment could be 
compared, and the validity across populations evaluated. 

The 66 clinical cases provided by Dr. Marcus (see 
Appendix A) included a brief patient description, including 
medical and dental histories; color slides of facial profiles 
and intraoral appearances; a set of radiographs, including 
periapicals, bitewings, and a panorex; a set of complete 
plaster mouth study casts; and a completed dental chart. 

The variables of interest for all 66 clinical cases had 
been previously extracted by Dr. Marcus and his coworkers 
and were embedded within the computer printouts containing 
the original, untransformed data. This data was extracted 


from thecomputer printouts and written onto case abstraction 
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forms, Figure 2, for each of the 66 cases. This data, 

with the following exception, was then entered into a working 
computer file for further analysis. The variables for the 
demographic and health variables were converted from the 
system used by Dr. Marcus and his co-workers to systems of 
"dummy" variables. Thus in the case of the race variable, 
father than entering a-1-i£-American Indian, a 2 if Black, a 
3 if Oriental, etc., dummy variables (1 or 0) were used to 
Pndacate that an individual belongs (1) “to that specific 
Gacial category, or does not (0)= Because the data within 
these variables were primarily qualitative rather than quanti- 
tative in nature, this methodology was considered more useful 
Meatictacally.- [Ret .299'5 p. lit] 

The initial data set for each of the 66 cases (see 
Appendix B), derived from the original, untransformed data 
Provided by Dr. Marcus, yielded 208 variables, as indicated 
in Figure 3. As can be seen, these included age; sex; race; 
history of diabetes, cardiovascular disease, or rheumatic 
fever; temporomandibular joint disease as manifest by sounds, 
fa ocation,- Loss of tunctzon,-or-pain;~occlusion, class I, 
Mor Li bs-crossbhi ce, anterior or ipesterior; gingivitis, 
acute or chronic; severely extruded teeth; severely abrated 
teeth; fractured teeth, mild, severe, or periapical; unerupted 
Eeerni; Missing teeth, total, cuspids, first molars, free ends, 
memenard molars; tipped teeth; virgin decay, mild, severe, or 


Balpal;>; recurrent decay, mild, severe, or pulpal; filled teeth, 
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CASE ABSTRACTION FORM 
Case No. Age Sex: Maie Femaie 
Race: American Indian (1 Health: Diabetes 
Biack (2) Cardiovascular 
Orientai (3) Rheumatic Fever 
Spanis- (4) 
White (5) 
Other ‘Specify) (6) ) 
IMI Occlusion Crossbite Gingivitis 
Sounds Ciass I Anterior Acute 
Disiocation Class II Posterior Chronic 
Function Kossi@inl Glacs= Li) mma And 
Pain Se 
[oA Upeer al lover eae 
a ee i a Bee 
Extruded Severe mn 
Abrasion Severe |_| eee 
Fracture | Mild iebeeie Piid De) eo ALE = | 
| Severe aaa 


| Feriapical 
Unerupted h 
Missing Tokar | 
| Cuspid/ st Moiar | 
| Free Ends 
3rd Moiar 













Tipped Teeth 
\Virgin 
|Decay 


Recurrent 
Decay 












































[Moderate (/S=l/o).p cl) a2 al iit pean ga 
a 
| | Severe (1/2) | | 
2 to) 3.9) mm | | =. an 
ee ee ee ee ee See 
= to 5.9 mm | | 
o~> mm | | i | 
|Mobiiit iass I ale | | | 
ass i jt | =i) | 
| Class IIT aif rite | 
*Totai does not include wisdom teeth. 
Source: Marc , Marvin; Gershen, Jay A.; "and *s0ch> Alneae 


Development .of.Oral Health. Status »Measures FormlOmausues 





Assurance. 





Health and the W.K. 
PLOUBe 2. 


Final Repere. 


Chi eage: 


Kellogg Foundation, 


Clinnteal cassie! abisiesaGekon 


American 


May 1980, p. 


fOusms 


Fund £or Demeck 


20° 








CASE ABSTRACTION FORM 














Case No. it Age 2 Sex:3 Male Femaie 
Race: American Indian (1) 4 Heaith: Diabetes 10 
Black (2) 5 Cardiovascular 
Oriental (3) 4 Rheumatic Fever 
Spanish (4) i 
White GS) 3 
Other (Specify) (6) 9 { ) 
TMJ Occlusion Crossbite Gingivitis 
Sounds Uae iGilaisiser 17 Anterior 20 Acute Te 
Dislocation 148 (Classi I iS GPosterior me Chronic <4 
Function Loss 15 Glass) LERSeLo 
Pain lo 













Extruded 
Abrasion 
Fracture 


EE Beier 
Peete oneod. 24 oes] 2 
38 
i 


Periapical 





(ey) ike 








UO 






Unerupted 
Missing 








Total* 
Cuspid/Is 
Free Ends 
3rd_ Molar 









Severe 






Recurrent 
Decay 






Severe 





















Fillings | Serviceable 








|(Direct) | Detective 
|Restorations| Serviceable 
\(Cast) | Detective 









jEndodontics | Serviceable 


3) we 
Derective Be’ 135 
>) 





Tumors 
Reo.taced 

















Fixed Ponctics 
| Removaodle 





peat Cul us 


t = 
iBone Loss 


Pockets 





\Mooiiity 











*Total does not inciude wisdom teeth. 


Puigiree ser Omg tal Wis Yclinical. yvariablest 


serviceable or defective; restorations, serviceable oF 
defective; tumors; replaced teeth, fixed pontics or removable; 


calculus; bone loss, mild, moderate, or severe; periodontal 


Se 


pockets, 0-1.9°mm, 2-3.9 mm, 4-5.9 tm, on 6 mm) and mobilfeg 
class I, II, or III. Additionally the latter of these ween 
extruded teeth through mobility, are also characterized by 
position of occurrence within the mouth, maxillary (upper) 
or mandibular (lower) and anterior (front) -s)posterior (oa 
as well as totals. 

It is these 66 “ases, with thetee208 varwables, Enemas 
vide the starting point for further analysis and investigaeseus 
primarily through the. BMDP prézerence, pales progam. 


[Refs. 296-297] 


C. THE PALRED (PREFERENCE PROGRAM 

The paired preference program, develoved by Mickey and 
Britt in the early 1970's [Ref. 295], provides a methodology 
for deriving numerical scores ar each efetheclinical casgieey 
based upon the judgments (preferences) onmexpe sy, Ln hae 
case, dentists. This methodology is available -Ehrough the 
BMDP statistical software packages developed by the Univers#® 
Of Caliatorniva® (Reftst -300=—304} 

The BMDP preference pairs program constructs a numerical 
score for each case that 1s a linear combination of the 
variables used in the analysis: 


Case Score = oy Sy + > “5 ae OE x3 pe eo a non? 
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where the Beta-coefficients are derived from the judgments 
(preferences) of experts, in this case dentists. [Ref. 296: 
Pp. S474 

The dentists compare two clinical cases at a time, 
evaluating whatever data and information is of value in that 
professional's particular methodology of clinical assessment, 
and selects” the’ case felt to be in better oral health. 

The input to the BMDP preference pairs program consists 
Gua preference Matrix and a data matrix. The preference 
Matrix is composed of the paired cases and the preferences 
of the dentists (see Appendix L). The preference of each of 
the dentists is indicated as follows: If the first case of 
the pair is preferred over the second, the preference is 
noted as a "1", if the second case of ‘the pair is preferred 
over the first, the preference is noted as a "-1". When no 
preference is indicated, a zero is recorded (an option Marcus 
eWeenisacoworkers did not permit) [Ref. 285: p. 13]. The — 
strength of the preference may also be indicated. For 
example, if the first case is preferred twice as much as the 
second, a "2" would be recorded; if the second case is pre- 
ferred three times as much as the first, a "3" would be 
recorded. The data matrix is composed of the variables in 


the data base of each case. [Ref. 296: p. 547] 


For each pair of cases, Ys = (Xs45 Xso1 X. 3 hag Xs.) 
ne (eX er Xe ne tas) hus), a judgement vector , (the 
j MG £wj2ter73 jr nae 
: 1 a = = Ge . ig u 
dentist's preference), Z (X54 ae Xo 5 L3y Xs 3 =a F 
eet) Xen = ) iS computed. A cross-product Matrix 1s 
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subsequently formed, stepwise multiple regression is 
accomplished, an algorithm (model) is developed for each 
dentist, and scores are calculated for each clinical case. 
[Ref.. 2963. p..5438] 

The Beta-coefficients determined for each of the varia- 
bles (Xs) provides the weights (clinical importance) of the 
dentist's judgments (clinical assessments of oral health) 


for those variables within the data base. [Ref. 296: p. 547] 


D. A FIRST LOOK 

The original, untransformed data base (see Appendix B), 
containing 66 clinical cases with their respective 208 
variables, was processed through the BMDP preference pairs 
program [Ref. 296: pp. 547-553]. The results of this analysis 
are provided in Appendix C. As can be seen from the data, the 
preference pairs program develops a separate model (algorithm) 
for each dentist. Additionally, the program ean formatted so 
that a model was developed for the "average" dentist for 
subsequent use in constructing an oral health status index. 

The data in Table 1 is abstracted from Appendix C and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. As can be noted, 
no two dentists have exactly the same model. 

The number of variables ranges from 21, for the second 
dentist, to 23 for the "average" dentist; with(22 varrables 


for all others. The variables involved differ from dentists 
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model to dentist's model. Additionally, even when the same 
variables are involved, the Beta-coefficients (weights) and 
t-values differ significantly between individual dentists. 

As can be seen in Table 1, the R-squared values, showing 
the "goodness of fit" of the individual models, range from 
eeoo for the “average” dentist, to 1.000 for the third 
dentist. Based on the work of Nikias et al., this finding 
was not at all unexpected. In their work on developing an 
oral health status index based upon ranking of oral status 
profiles by panels of dental professionals, Nikias et al. 
found that dentists tended to develop very individual models 
Sevclinical assessment. The greatest variability in clinical 
assessment occurred between dentists when clinical cases 
contained a combination of contrasting levels of oral disease 
and conditions which brought them close to the same level of 
Overall oral health. [Ref. 308: pp. 21-25] Thus in a situation 
where the clinical cases are intentionally paired so that 70% 
@f them are very close in overall oral health, as they are in 
this situation [Ref. 285: p. 25], one would expect the R-squares 
Pere the individual) dentists'; models to be higher than that for 
the "average" dentist's model. 

OE principal importance: is the “average" dentist's model, 
since this model provides the foundation for any oral health 
status index subsequently developed. As can be seen in Table 
1, the greatest t-values (B/SEB) are associated with the 


following variables: total severely fractured teeth (1.183); 


oye 


total lower posterior missing teeth (0.541); upper 

posterior tipped teeth (0.420); lower anterior teeth with 
virgin decay (0.402); being female (0.105); and lower 
anterior replaced fixed pontics (0.101). Not only does the 
size of the model (the number of variables involved) make it 
impractical for use as an oral health index, the directions 
of some of the Beta-coefficients (weights) are) intuveryers 
bothersome in this model. For example, total severely frac- 
tured teeth is positively related to oral health (0.62540), as 
is upper posterior tipped teeth (0.01511). More will bevsaea 
about this phenomenon later. 

Table 2 provides a correlation matrix revealing correlations 
between clinical case scores as computed through each indi- 
vidual dentist's model. As can be seen, the correlations 
range from -0.0598 (between dentists nine and eleven) to 0.6789 
(between dentists eight and twelve). 

The work of Nikias et al. had indicated that high correla- 
tions under these circumstances should not be expected. [Ref. 
308: pp. 21-25] Marcus et al. in their work in developing an 
oral health status index, however, had reported very high 
correlations between judges' scores, ranging from 0.8156 to 
0.9623... [Ref. 285: pp. 41-42) 

Examination of dentists' preferences within specific case 
pairings, however, showed a wide range (see Appendix L). For 
example, for pairings of clinical cases four and sit=,9er— 


twelve dentists' preferences ranged from -2 to 2 (2, —l, lL, j=2y 


a2 
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3) 5} 


-2, 1,°1, 27:1, 2pelbp and 2), as was true ttor eienrcan 

Cases 43 and seven (ljewly -lLes=Z, (4,125) —lent, eee eee 
LL), thirty sand: 36 (ly 7-Lye-loe 27042311, 2368762.) —-25 Cee 
-1), and) forty and five (1,.-1; s1;)\2,i\2¢ livsipe2, tee 
and 1). It should be noted that these represent the maximum 
range (-2 to 2) allowed by Marcus et al. when pairings of 
clinical cases were presented to the dentist consultants. 
fRef.4285: pe 23] 

In fact; only 30.4 percent of the pairingspor) thenae 
clinical cases revealed the same direction for all twelve 
dentist's preferences (all preferred the first case (+) or 
all preferred the second case (-) of any pairing). And none 
of these pairings revealed the same degree of preference (all 
ones or all twos) for any one case over its alternative 


selection. 


E. CLUSTERING INTO FACTORS 

The original, untransformed data base (see Appendix B), 
containing 66 clinical cases, with their respective 208 
variables, was processed through the BMDP factor analysis 
program [Ref. 302: pp. 480-499] in an attempt to reduce the 
number of variables under consideration through clustering 
the initial variables into "factors", composed of several 
variables, which seemed to provide the greatest explanatory 
power for the dentists" preferences. 

Forty-nine factors, largely corresponding to the totals 


of each of the major variables (a sum of the positional 
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variables) initially seemed to have the greatest explanatory 
Bower fot the Gentists" preferences. Six of these factors, 
however, were subsequently dropped. These factors related 
mespone loss (mild, moderate; "and severe) and tooth mobility 
Setaes ft, IL, and Itt) variables). Bone loss is highly 
correlated with, and essentially measures the same clinical 
phenomenon as, periodontal pocket depth. [Refs. 303-306] Thus 
bone loss, as determined from radiographic measurements using 
the Schei scale [Ref. 303], was eliminated and periodontal 
pecket depth, as measured by use of (a periodontal probe, was 
fecained. Tooth mobility, like, bone. loss, is; also highly 
correlated with periodontal pocket depth. Additionally, 
however, there are measurement problems with tooth mobility 
that make measurement of periodontal pocket depth more advan- 
tageous in assessing oral health status. [Ref. 307] Tooth 
mobility was thus eliminated in favor of periodontal pocket 
depth measurement. It should be noted that all three of these 
maectors (bone loss, periodontal pocket depth, and tooth 
mobility) were included within the variables labeled periodon- 
tal disease (mild, moderate, and severe) in Marcus and his 
Beworkers initial work. (Ref: 285: 9p. 27] They too, however, 


etected to eventually eliminate bone loss and tooth mobility 


eeem their final direct oral health index, retaining periodontal 


pocket depth as a measure of periodontal disease. [Ref. 285: 
pp. 78-79] 
A new, transformed data base was created (see Appendix D) 


Bemeaining 66 Clinical cases with their new 43 factors 


ay) 


TABLE 3 


FORTY-THREE TRANSFORMED 
VARIABLES FROM SIXTY-SIxX 
CLINICAL CASES. 


VARIABLE VARIABLE NAME 

X1* Case No. 

X2 TMJ Sounds 

X3 TMJ Dislocation 

x4 TMJ Function Loss 

X5 TMJ Pain 

X6 Occlusion, Class I 

X7 Occlusion, Class II 

X8 Occlusion, Class III 

x9 Crossbite, Anterior 

X10 Crossbite, Posterior 

X11 Gingivitis, Acute 

X12 Gingivitis, Chronic 

X13 Extruded, Severe, Total 

x14 Abrasion, Severe, Total 

X15 Fracture, Mild, Total 

X16 Fracture, Severe, Total 

X17 Fracture, Periapical, Total 

X18 Unerupted Teeth, Total 

X19 Missing Teeth, Total** 

X20 Missing Teeth, Cuspid/lst Molar, Total 
X21 Missing Teeth, Free Ends, Total 

X22 Missing Teeth, 3rd Molar, Total 

X23 Tipped Teeth, Total 

X24 Virgin Decay, Mild, Total 

X25 Virgin Decay, Severe, Total 

X2 Virgin Decay, Pupal, Total 

X27 Recurrent Decay, Mild, Total 

X28 Recurrent Decay, Severe, Total 

X29 Recurrent Decay, Pupal, Total 

X30 Fillings, Serviceable, Total 

X31 Fillings, Defective, Total 

X32 Restorations, Serviceable, Total 
X33 Restorations, Defective, Total 

X34 Endodontics, Serviceable, Total 

X35 Endodontics, Defective, Total 

X36 Tumors, Total 

X37 Replaced Teeth, Fixed Pontics, Total 
X38 Replaced Teeth, Removable, Total 
X39 Calculus, Total 

x40 Periodontal Pockets, 0-1.9mm, Total 
X41 Periodontal Pockets, 2-3.9mm, Total 
X42 Periodontal Pockets, 4-5.9mm, Total 
X43 Periodontal Pockets, 6+mm, Total 
*Case label only, not involved in regression. 


**Total does not include wisdom teeth. 
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(variables) (see Table 3). As can be seen in Table 3, the 

new 43 factors include variables for temporomandibular joint 
disease (sounds, dislocation, loss of function, and pain) ; 
Seclusion (class) ie Id ,“and) 111) >° crossbite’ (anterior and 
posterior); gingivitis (acute and chronic); extruded teeth 
(severe); abrated teeth (severe); fractured teeth (mild, 
severe, and periapical); unerupted teeth; missing teeth 
(total, cuspids, first molars, free ends, and third molars) ; 
tipped teeth; virgin decay (mild, severe, and pulpal) ; 
recurrent decay (mild, severe, and pulpal); fillings (service- 
able and defective); restorations (serviceable and defective) ; 
endodontics (serviceable and defective); tumors; replaced 
teeth (fixed pontics and removable); calculus; and periodontal 
pockets (0-1.9 mm, 2-3.9 mm, 4-5.9 mm, and 6+ mm). 

This new, transformed data base (see Appendix D), contain- 
ing 66 clinical cases with their respective 43 variables, was 
processed through the BMDP preference pairs program [Ref. 296: 
pp. 547-553]. The results of this analysis are provided in 
Appendix E. As can be seen from the data, the preference 
pairs program again developed a separate model for each 
dentist as well as a model based upon the "average" dentist. 

The data in Table 4 is abstracted from Appendix E and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. Again, as with 


the earlier BMDP preference pairs program output with 208 
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variables, no two dentists have exactly the same model. There 
are 22 variables for each of the dentists' models and 23 varia- 
bles for the "average" dentist's model. As noted in the 
earlier model, the variables involved differ from dentist's 
model to dentist's model. Additionally, as seen before with 
208 variables, even when the variables are the same, the Beta- 
coefficients (weights) and t-values for each of the dentists 

ali ffterrgsignaticanely.. 

As can be seen in Table 4, the R-squared values of the 
individual models range from 0.566 for the "average" dentist 
to 1.000 for the third dentist. The earlier discussion con- 
cerning R-squared values applies here as well. 

As before, the model developed for the "average" dentist 
is of pivotal importance in any subsequent development of an 
oral health status index. As can be seen in Table 4, the 
greatest t-values (B/SEB) are associated with the following 
variables: total severely extruded teeth (1.185); total 
teeth with recurrent pulpal decay (0.735); temporomandibular 
joint pain.(0.706); chronic gingivitis (0.663); total mesa 
teeth, free ends (0.619); and total replaced teeth, fixed 
pontics (0.548). As in the earlier BMDP preference pares 
program output using 208 variables, however, the sizé Of 9the 
model (number of variables) make it impractical for use as an 
oral health index and the directions of some of the Beta. 
coefficients (weights) in this model are again intuitively 


bothersome. For example, total severely extruded teeth is 
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positively related to oral health (0.22906), as is temporo- 
mandibular joint pain (0.41258). More will be said concerning 
this phenomenon later. 

Table 5 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from -0.2159 (between dentists three and twelve) to 
0.6030 (between dentists one and three). The earlier discus- 
sion concerning correlations between clinical case scores, in 
the BMDP preference pairs program using 208 variables, applies 


here as well. 


F. PARING DOWN 

The transformed data base (see Appendix D), containing 
66 clinical cases, with their respective 43 variables, was 
processed through the BMDP factor analysis program [Ref. 302: 
pp. 480-499] in a further attempt to reduce the number of 
variables under consideration, through further clustering of 
the previously transformed variables. 

Fourteen factors appeared to account for the majority of 
the explanatory power of these 43 variables, and are shown in 
Table 6. As can be seen, these variables include gingivitis 
(acute and chronic); extruded teeth (severe); fractured 
teeth; missing teeth (total and free ends), decayed teeth 
iwargin and recurrent); fillings and restorations; endodontics; 
Bemeacead teeth; and periodontal pocket depth (0-3.9 mm, 4-5.9 


mm and 6+ mm). 
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TABLE 6 


FOURTEEN CLINICAL VARIABLES 


Variable Variable Name 
X1* Case Number 
X2 Gingivitis, Acute 
X3 Grngavitrs,s Chronic 
X4 Extruded Teeth, Severe Total 
X5 Fractured Teeth, Total 
X6 Missing Teeth, Total** 
X7 Missing Teeth, Free Ends, Total 
X8 Decayed Teeth, Total 
x9 Filled and Restored Teeth, Total 
X10 Endodontics, Total 
xi Replaced Teeth, Total 
Kale Periodontal Pockets, 0-3.9 mm 
x13 Periodontal Pockets, 4-5.9 mm 
X14 Periodontal Pockets, 6+ mm 


ee ee ee 
*Case label only, not involved in regression. 
**Total does not include wisdom teeth. 


This newly transformed data set (see Appendix Ey con= 
taining 66 clinical cases with their respective 14 variables, 
was processed through the BMDP preference pairs program [Ref: 
296: 547-553]. The results of this analysis are provided in 
Appendix G. As can be seen from the data, the preference 
pairs program again developed a separate model for each 
dentist as well as a model based upon the "average" dentist. 

The data in Table 7 is abstracted from Appendix G and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program fOr each Of the 


twelve dentists as well as the "average" dentist. Again, as 
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with the earlier BMDP preference pairs programs with 208 and 
43 variables, no two dentists have exactly the same model. 
Although the same variables are involved in each individual 
dentist's model, the Beta-coefficients (weights) and t-values 
of the variables within each of the dentist's models differ 
Significantly. 

As can be seen in Table 7, the R-squared values of the 
individual models range from 0.399 for the second dentist, to 
0.850 for the fourth dentist. Unlike the earlier BMDP preft= 
erence pairs programs, for 208 and 43 variables, however, the 
model developed for the "average" dentist does not possess the 
lowest R-squared value, but is an intermediate value, 0.494. 

As with models seen previously, the model developed for 
the "average" dentist is of pivotal importance in any sub- 
sequent development of an oral health status index. As can 
be seen in Table 7, the greatest t-values (B/SEB) are associa- 
ted with the following variables: chronic gingivitis (4.047); 
acute gingivitis (3.323); total missing teeth (88286); taeas 
decayed teeth, virgin and recurrent (3.175); total periodontal 
pockets, 4-5.9 mm (2.745); total severely extruded teeth 
(2.452) 2 total periodontal pockets,—0-3.9 mm «a(2).328);) ane 
total free ends (2.095). As with earlier BMDP preference 
pairs program outputs with 208 and 43 variables, however, the 
directions of some of the Beta-coefficients (weights) in this 
model are intuitively bothersome. For example, acute gingivitis 
is positively related to oral health (1.18728), as are Severe 


extruded teeth (0.18096) and total fractured teeth (0.13272). 
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Table 8 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from -0.2159 (between dentists three and twelve) to 
0.603 (between dentists one and three). The earlier discus- 
sion, concerning correlations between clinical case scores 
in the BMDP preference pairs program using 208 and 43 variables, 


applies here as well. 


G. A WORKABLE MODEL? 

The newly transformed data base (see Appendix F), con- 
taining 66 clinical cases with their respective fourteen 
variables, was processed once again through the BMDP factor 
amalysis program [Ref. 302:;..pp. 480-499], in a further 
attempt to reduce the number of variables under consideration, 
Pycough additional clustering of the newly trans formed 
variables. 

Seven factors appeared to account for the vast majority 
of the explanatory power of the fourteen variables, and are 
shown in Table 9. As can be seen, these variables included 
decayed teeth (including fractured teeth, virgin decay, 
Becurrent decay, defective fillings, defective restorations, 
and defective endodontics); replaced teeth (fixed pontics 
and removable); and periodontal pocket depths (2-3.9 mn, 
4-5.9 mm, and 6+ mm). 

The newly transformed data base (see Appendix H), con- 


taining 66 clinical cases, with their respective seven variables, 
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TABLE 9 


SEVEN CLINICAL VARIABLES 


Variable Variable Name 

X1* Case Number 

X2 Missing Teeth, Total 
x3" Decayed Teeth, Total 
x4 Replaced Teeth 

XS Periodontal Pockets, 
X6 Periodontal Pockets, 
X7 Periodontal Pockets, 


*Case label only, not involved ir 


TS 


was processed through the BMDP preference pairs program 
[Ref. 296: pp. 547-553]. The results of this analysis are 
provided in Appendix I- As can be seen from the data, the 
preference pairs program again developed a separate model 
for each dentist as well as a model based upon the "average" 
dentist. 

The data in Table 10 is abstracted from Appendix I and 
provides the final step from the stepwise multiple regression 
portions of the BMDP preference pairs program for each of the 
twelve dentists and the “average" dentist. Again, as with 
earlier BMDP preference pairs programs using 208, 43, and 14 
variables, no two dentists have exactly the same model. 
Although the same variables are involved within each individual 
dentist's model, the Beta-coefficients (weights) and t-values 
drt ter signitcrantly.. 

As can be seen in Table 10, the R-squared values of the 
individual dentists' models range from 0.339 for the fifth 
dentist, to 0.736 for the sixth dentist. The R-squared value 
of the "average" dentist's model is 0.427, and as in thewlace 
model, using fourteen variables, is not the lowest of the 
R-squared values. 

As in the models developed previously, using 208, 43, and 
14 variables, the model developed for the "average" dentist 
is of pivotal importance in subsequent development of an oral 
health status index. As can be seen in Table 10, the t-values, 


in descending order, for the seven variables were: total 
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missing teeth and free ends (7.000); total periodontal pocket 
depth, 6+ mm (5.948); total periodontal pocket depth, 4-5.9 
mm. (4.775) ;. total periodontal.pocket depth 6+ mm (4.118); total 
replaced teeth (2.850); and total decayed teeth (1.032). 
Unlike earlier models developed by the BMDP preference pairs 
program with 208, 43, and 14 variables, all Beta-coefficients 
of the seven variables appear to be in appropriate directions. 
POrpexample, , total missing teeth and free ends.are negatively 
related to oral health (-0.328), as are total decayed teeth 
(-0.01522), and total periodontal pocket depths, 2-3.9 mm 
(-0.19654), 4-5.9 mm (-0.23257), and 6+ mm (-0.34511); while 
total replaced teeth is positively related to oral health 

hOe1 34,13)... 

Table 11 provides a correlation matrix revealing correla- 
Erons between clinical.caseé~scores computed through) each 
individual dentist's model. As can be seen, the correlations 
range from 0.4838 (between dentists five and ten) to 0.9872 
(between dentists one and twelve). As can also be seen, these 
Peer idt1Ons. differ | sagnittceantly, from those, seenyearlier with 


POo..43, and.14 variables. 


H. FROM MODEL TO INDEX 

The last BMDP preference pairs program model developed 
above, using seven variables, appeared to provide a reasonable 
basis for development of an index of oral health status. 
Peeee, Lt was composed of a practical number of variables, 


Bewen. Second, it appeared clinically valid. That is, it 
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combined elements common to most of the oral health indexes 
developed in the past: decayed teeth, missing teeth, re- 
placed teeth, and periodontal pocket depths. Additionally, 
where there are differing levels of clinical severity, both 
the Beta-coefficients (weights) and t-values (statistical 
significance) show appropriate movement. For example, 
periodontal pocket depths of 2-3.9 mm have Beta-coefficients 
Of -0.19654 and t-values of 4.118; periodontal pocket depths 
of 4-5.9 mm have Beta-coefficients of -0.23257 and t-values 
of 4.775; and periodontal pocket depths of 6+ mm have Beta- 
coefficients of -0.334511 and t-values of 5.948. Thus the 
model indicates not only increasing clinical weights associa- 
ted with increases,.in clinical severity, but reveals increasing 
Beatistical significance with increases in clinical severity 
as well. 

As can be noted in Appendix I, part of the output of the 
BMDP preference pairs program is a computation of scores based 
On judgments evaluated for each case", the clinical case 
scores based upon the individual and "average" dentist's 
assessments and preferences. The clinical case scores for 
Bue javerage” dentists are those of primary interest in 
construction and development of an oral health status index. 
As can be noted in Appendix I, the 66 clinical case scores 
developed for the "average" dentist range from -3.36 (-3.35518) 
foe10-54 (-10.53981), with .amean of -7.29.(-7.2880591). and 


SeimtandacG deyviation-.of...5 (1:49915.847),....0£.the 66,celinical 
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case scores, 96.97 percent (64/66) of the absolute values 
were less than 10.00. | 

As in the work of Marcus et al., an oral health index with 
a maximum score of 100, indicating complete oral health, was 
desired primarily for aesthetic reasons. Concern that negative 
values might also be obtained was minimal, particularly con- 
sidering the differences between the population of interest 
within the uniformed services health benefits program and the 
population serviced by the UCLA dental school (to be discussed 
later). Consequently, the clinical case scores obtained from 
the BMDP preference pairs program (see Appendix I) were multi- 
plied by a constant value (ten), and the variables contained 
within the data base for the 66 clinical cases (see Appendix 
H) regressed against the products using the mee eee regression 
methodology available through the Minitab system developed at 
Penn State: [Ref. 309: pp. 166-171] As can be seen in Table 
12, the equation's y-intercept was essentially zero (-0.0007935) 
and the order of the Beta-coefficients was preserved (as expec- 
ted when multiplying by a constant), with missing teeth and 
Free-ends, decayed teeth, replaced teeth, periodontal pocket 
depths 2-3.9 mm, periodontal pocket depths 4-5.9 mm, and 


periodontal pocket depths 6+ mm, having Beta-coefficients of 


-3.8 (-3.279975891), -0.15 (-0:.152220916), 1.34 (t234t2e 
-1.97 (-1.965415), -2.33 (-2.32565402), and -3.45 (-3.45171465m% 
respectively. 
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TABLE 12 


RESULTS OF MULTIPLE REGRESSION OF SEVEN VARIABLES 
AGAINST ORAL HEALTH STATUS INDEX SCORES OF 66 
CLINICAL CASES. 





Variable Variable Name B-Coefficient 
Intercept -0.0007935 

xoL* Case Number 
X2 Missing Teeth and Free Ends =S 527991569. 
X3 Decayed Teeth =O). 152220916 
x4 Replaced Teeth 1.34132 
X5 Periodontal Pockets, 2-3.9 mm =1.965415 
X6 Periodontal Pockets, 4-5.9 mm -2.32565402 
X7 Periodontal Pockets, 6+ mm -3. 45111465 


*Case label only, not involved in regression. 


7S provide a numericali)score for the oral health’ status 
index, the variables for ech of the clinical cases are 
multiplied by their respective Beta-coefficients, summed, and 
the total subtracted from 100. The scores of the index of 
Smart nmealth for each of the 66 clinical cases are calculated 
and shown in Table 13. As can be seen, the final scores 
memged from -5 (-5.398) tor66 (66.448), with a mean of 26 
(26.204), a median of 26 (26.949), and a standard deviation 
pee (12.443). 

mo use thrsMoral health status index on new clinical 
cases, similar procedures are employed. The number of missing 
teeth and free-ends; decayed teeth; replaced teeth; and 
periodontal pocket depths of 2-3.9 mm, 4-5.9 mm, and 6+ mn, 


@ee first ascertained through clinical examination. The 


83 


totals for each of these clinical categories are totaled, 
multiplied by their respective weights (Beta-coefficients), 
and the sums subtracted from 100 to yield the index score. 

Eight-two individuals (active and retired military 
personnel) were examined at the Naval Postgraduate School 
(NPS) by Navy Dental Corps officers, the oral health status 
of each assessed, and oral health status index scores 
calculated. As can be seen in Table 14, the final scores 
ranged from 40 (40.247) to 100, with a mean of 91 (1.354), 
a median of 99 (99.391), and a standard deviation of 15 
GS 24770).¢ 

Welch's approximation for the t' statistic was computed 
using the statistics (mean, variance, and number of observa- 
tions) derived from the clinical case scores of the two 
populations (UCLA patient sample, 66 cases, and NPS patient 
sample, 82 cases) and, as might be expected from even a 
casual examination, the two populations are statistically 
distinct from one another (with a t' statistic ‘o£ 928 738G)gae 
virtually any level of statistical significance. [Ref. 310: 
pp. 298-299] This fact may be a significant factor in the 
development, construction, and implementation of an oral 
health index for any population, a factor to be discussed 
later. 

The evaluation of Marcus and his coworkers' direct oral 
health status index has provided significant findings for 


subsequent research and development of oral health indexes, 
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TABLE 13 


ORAL HEALTH STATUS INDEX SCORES FOR UCLA 
PATIENT SAMPLE OF 66 CLINICAL CASES. 


Case No. Index Score Case No. Index Score 


x 30. 25 34 Sat58 

30..-65 35 3i8ieal 3 
3 TD. he 36 30423 
4 rays se 8) 37 26.29 
3) 36). oS 38 40.26 
6 20.90 Be) 8.40 
7 LOR 40 38.55 
8 29.00 41 0) Gio 
3 36.66 42 26.94 
10 Sy Ply 43 24.02 
La 66.44 44 PLS a) 
12 210. 5 45 33. 06 
13 Sib 77ue 46 3605 
14 24-15 47 40.41 
De) BZ) O 48 S039 7: 
16 38.44 49 14.03 
7 34.64 50 25.86 
18 a5. 105 OL L324 
1g el ean 52 Zar 3 
20 SSS) 53 LsZe-07'6 
Zk (dks 54 25-708 
22 3'6".12.3 55 3.42 
23 SOE on 56 VA ay Al 
24 PLM ley? Ori, 92993 
25 23.55 58 TORO 1: 
26 BZ oro 2S) Tetralte 
27 ZG ie) 60 24.29 
28 34.34 61 26.40 
BS. ST oe 62 AGT)? 
30 34.20 63 Le s0'6 
ot 5,0 5 5) 64 20'52 6 
gz 26.36 65 She 919 
33 9.14 66 Gp 2 


Number of observations = 66 
Mean = 26.204 é 
Median = 26.949 

Standard deviation = 12.443 
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TABLE 14 


ORAL HEALTH STATUS INDEX SCORES FOR NPS 
PATIENT SAMPLE OF 82 CLINICAL CASES. 


Case Index Case Index Case Index 


No. Score No. Score No. Score 
ni 63.89 29 99.39 Si 7) 100.00 
7) 82.83 30 SiSiesa 58 100.00 
3 Wa WA Sit sitaye 7/7 59 100.00 
4 96 72 3h 83.18 60 100.00 
5 93.44 33) 99.39 61 100.00 
6 90.69 34 69.92 62 100.00 
7 40.24 35 96.26 63 100.00 
8 99.84 36 96.41 64 100.00 
9 99.84 3)7/ 96.41 65 100.00 
10 S)).6 (Jal 38 93.44 66 100.00 
Wal WT ois! 39 22.90 3)7/ 100.00 
2 Hes Oak 40 72.84 68 100.00 
1S Wis 4l 99.39 69 100.00 
14 99.84 42 98.93 70 100.00 
LS lS} 5 AAs! 43 63.63 Hak 100.00 
16 91.98 44 91.34 WZ 100.00 
7 99.54 45 98.93 qe 100.00 
18 96.56 46 99.54 74 100.00 
19 9834 47 99.93 75 OO S00 
20 96.56 48 100.00 76 100.00 
Prat 79.82 49 100.00 WW 100.00 
D2. 88.48 50 100.00 78 100.00 
D3 Se. Sb 100.00 79 100.00 
24 97.90 Bz 120/0:-70'0 80 100.00 
25 66.88 53 10/'O,2010 81 100.00 
26 FOSS 54 OOOO 82 100.00 
DT WB. 18 55 100.00 

28 28).3:0 56 100.00 


Number of observations = 82 
Mean = 91.354 

Median = 99.391 

Standard deviation = 15.470 


particularly within the military health services sec uae 


These findings are addressed within the following chapter. 
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V. FINDINGS AND CONCLUSIONS 


Ae ORAL HEALTH STATUS INDEX 

The oral health status index, as developed by Marcus et 
al. [Refs. 285-293], and currently configured, appears inade- 
migace fOr use as a Navy oral health status index for a number 
of reasons. 

1. Sampling Problems 

When evaluating the applicability of the oral health 
status index for assessing the oral health status of military 
personnel, a significant problem arises as a result of the 
sample population selected for its development. 

The population, from which the patient sample was 
drawn, was composed of patients examined and treated at the 
Veterans Administration Hospital, Los Angeles; Public Health 
Service Hospital, Los Angeles; and University of California 
at Los Angeles Dental School. 

This patient sample is significantly different from 
that encountered within the patient population served by the 
Navy, as can be seen by examining the data presented within 
Meetes 13 and 14. As noted previously, the two populations 
Mees tatistically distinct Erom one another, as determined 
meewelch's approximation for the t' statistic, at virtually 
ameelevel of statistical significance (t' statistic,of 28.388). 


[Ref. 310: pp. 298-299] 
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The fact that dental health professionals apparently 
use different factors (variables) in assessing the oral health 
status of different populations was pointed out by Marcus et 
al. and Koch et al. during development of the direct adult oral 
health status index and the children's oral health status 
index, respectively. [Ref. 285-293] 

As can be seen by examination of the direct oral 
health status index adult examination form in Figure 4, and 
the children's oral health status index examination form in 
Figure 5, the variables comprising each index, as well as 
their clinical importance (Beta-coefficients (8) or weights), 


are different. The direct adult oral health status index 


considers missing teeth (8 = -3.13), free ends (8 = -3.13), 
replaced teeth (8 = +0.61), decayed teeth (8 = -1.79), 
periodontal pockets 4-6 mm (8 = -0.73), and periodontal 
pockets 6+ mm (8 = -3.02). [Ref. 292: p. 729] The childrens 


oral health status index, however, considers missing teeth, 


anterior primary (8 = -2.27), posterior primary (8 = -4.55), 
and all secondary (8 = -4555); decayed teeth, anterrer 
primary (8 = -1.22), posterior primary (6 = -2-24)) andgaus 
secondary (8 = -.2.24); occlusion (8 = -4.38); and abnormal 
‘position’ (B= =LU73)." [Reet 2933p oon 


In a situation where the population of interest is 
significantly different from that for which the index twas 
developed, as it is in this case, the applicability of the 


index must be considered questionable. 
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PATIENT 1.D.: 
BIRTH DATE: 


DIRECT ORAL HEALTH STATUS INDEX 


ADULT EXAMINATION FORM 


Tooth |] Teeth Bone Loss 
* 4-6mm 6+m 


RPO-BMAYOD 


BmAword 


2o- 


TRO- BmMAWOYD 





rODyey BDMEOr 





RBO-BDMALOD 


Figure 4. 











Drrect-oral 
examination 


DATE: 
EXAMINER: 


LEGEND: 

M = missing 

R = replaced 

D = decayed 

N = normal 

C = space closure 
FE = free end 











Subtotal 





health status index adult 


if Oem 
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CHILDREN'S ORAL HEALTH STATUS INDEX 
EXAMINATION FORM 


2 DATE: 
So —————— EXAMINER 1.0. 


OCCLUSION: 

CROSSBITE = 1° ANT. 1° POST 
OVERBITE = EXCESS ( >4mm) OPEN (< -1) 
OVERJET = EXCESS ( >4mm) ABSENT (< 1mm) 
PROFILE = CONCAVE ___ STRAIGHT/CONVEX O 
NORMAL O 


2° ANT 2° POST. NONE OQ 
NAG NORMAL (-1 to4mm)Q TOTAL 


NAO NORMAL (1-4mm) O OCCLUSAL CHECKS 





























LIPS = INCOMPETENT 





ABNORMAL POSITION: 





























SPACELOSS UPPER ANT. _____ UPPER POST. _____ LOWER ANT. ____ LOWER POST. NAO 
CROWDING 1° = UPPER ANT UPPER POST LOWER ANT LOWER POST NAQ 
CROWDING 2° = UPPER ANT. UPPER POST LOWER ANT. LOWER POST NAO 
LEGEND: 
M = Missing 
a D + Oecaved 
S =Sound 
| | [art] teem [[rootn a [roomal| Teetn || a | AP = Apnormal Position 
se aaa (rotated, displaced, 
tipped, ankyiosed, 
ectopic) 
TALLY 

















Abnormal 
Position 














Figure 5. Children's oral health status index 
examination form. 
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2. Statistical Problems 

There appear to be a number of problems, primarily 
related to the use of statistical procedures and manipulations, 
involved in the oral health status index's development, con- 
Seruction,; and application, that render the validity of the 
index questionable. 

First, although the stated purpose for the development 
and construction of the oral health status index was to identi- 
fye the decision factors that correspond, in a statistical 
sense, to the quantitative framework of the dentists' judgments," 
Marcus and his coworkers introduced potential bias by assigning 
clinical "Severity weights" to all variables (See Figure 6). 

These clinical severity weights were not made availa- 
ble to the dentists performing the paired preference experiment 
but were used to transform the raw data within each, clinical 
case prior to use in the BMDP preference pairs statistical 
software program. [Ref. 285: pp. 28-29] 

The resulting Beta-coefficients (clinical weights), 
consequently, reflected not only the interactions between the 
dentists' preferences and the variables involved in each of 
the cases, but a systematic bias introduced by transforming 
the raw variables through multiplication by the assigned 
clinical severity weights. 

Second, although the final adult oral health index 
uses only the total number of teeth for each of the clinical 


categories (variables), during the development and construction 


Ora 


CASE ABSTRACTION FORM 


Case No. Age Sex: Male Female 

Race: American Indian (1) Health: Diabetes 3 
Black (2) Cardiovascular _j405 
Oriental (3) Rheumatic Fever] 
Spanish (4) 
White (5) 
Other (Specify) (6) ( ) 

TMJ Occlusion Crossbite Gingivitis 

Sounds 1 Class I ] Anterior 3 Acute fal 


Dislocation 1.5 Class II 3 Posterior] Chronic Q 
Function Loss 5 Class III_ 3 
Pain Z 












tower’ 4a 
[ant | Post. | Ant. | Post sTorall 















Ce ee 
Severe. || aaa | |e | 
Rr ae a ee aE Ca aa 
oC Er | ee as La) 
Lott el ie hn Se 
oS iene 
Ri a ei aS Sees 
[iGuis pidV/ Vso Moil ar iail| ee 2 mn | | ee 
iFreePEndsi 7 Tit 7|/eow |e || siomi aS ea om 
ee 


Virgin 
Decay 





Recurrent “ 
Decay isevere 7 6 ge ale eee eG 

SPulipalees a) ges ees | | es | 
Fillings ” (sltsemviceable,. . 3(0 6] | 2763 ee 
(Direct) Se a od 
estoratiuel serwiecabie | | 1) 


(Cast) [Defective 






























Endodontics ee 
me ares 
TG Se ae eS 


Replaced | Fixed Pontics | 1 | 1 | 1 |] | 25] 

Removable ___{}_a.5 2} a} 26 
7 ae 
Bone Loss Ta CeST =o era ca a P 


[4 Sg eee ce el 
peer O12) a ae 









ge 
pabiliey” _ fClasa Tf pe 
ToT Ths a ka ES 
[Claas TTR 0 pe Pee ee 


*Total does not include wisdom teeth. 


Figure 6. Clinical severity weights as assigned by 
Marcus et al. during development of the 
Oral health status index. 
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of the index, "most of the adult variables were transformed 
from absolute numbers to percentages for inclusion into the 
paired preference program." [Ref. 285: p. 28] 

~Beta-coefficients (clinical weights) of index variables 
were generally derived from the use of three different deter- 
mMinants: (1) the number of teeth within each clinical category, 
divided by the total number of teeth present in the patient's 
mouth, and expressed as a percentage; (2) the variables' 
respective clinical "severity weights", and (3) the preferences 
of the dentist consultants. 

The use of the resultant Beta-coefficients within the 
final adult oral health index, however, is predicated on only 
the total number of teeth within each of the clinical categories. 
Neither the percentages of teeth present nor assigned "severity 
weights" are involved in calculation of the index. 

The problem in terms of the index's validity, lies in 
the fact that the index is being used to measure some factor 
Gtmer than that for which it was developed. 

third, che clinical case “scores, against which all 
subsequent multiple regressions were performed in developing 
the oral health status index, were obtained by processing the 
eumnacal cases containing 18 variables through the BMDP pref- 
€rence pairs program. [Ref. 289: p. 77] Subsequent multiple 
regressions performed in attempting to develop a model for the 
Beal health status index, regardless of which of the clinical 


Variables were involved, or the number of clinical variables 


OFS 


used, all had one fact in common. All equations were 
regressed against the same clinical case scores, those 
obtained during the original regressions of the equation 
containing 18 variables. Thus, the clinical scores used 

in all subsequent regressions in the development of the 
model for the oral health status index were not a function 
of the variables in the equation being regressed, which 
would have made the equations internally valid, but were 

a function of a different regression equation, one composed 
of 18 variables. 

Fourth, the choice of variables to be included 
within the final oral health index was based on somewhat 
arbitrary selection by Marcus and his coworkers rather than 
on purely statistical evidence. For example, the five 
variables selected for inclusion within the final index 
were not those variables with the greatest statistical 
Significance, as suggested by t-values, but were the resube 
of the researchers reaching a "strong consensus" on which 
variables should have been included within the final index. 
[Ref 285 0. 978) 

Fifth, there were a number of statistical manipula- 
tions performed, considered by Marcus and his coworkers to 
be "extremely informative", which appeared to be of ques- 
tionable value. 

For example, each of the total variables (the sum of 


the four positional variables) "was regressed on its locational 
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subcomponents (the four positional variables) ... in order 
to find more expedient ways to capture the quantitative 
information held in the whole variable." Recalling that 
the total variable of each clinical category was merely the 
sum of its positional components multiplied by arbitrarily 
assigned clinical severity weights, the value of such a 
regression in determining which variables should have been 
retained and which should have been discarded was questionable. 
This was particularly true when emphasis was put on statistics 
such as Beta-coefficients, t-values, and R-square values, 
resulting from such statistical procedures. 

There were enough of these problems in the development 
and construction of the oral health status index that the 
statistical validity of the index should have been considered 


questionable. 


B. PROBLEMS ENCOUNTERED IN DEVELOPMENT OF A MODEL 

The work described in the previous chapter was accomplished 
primarily to resolve a number of the problems inherent in 
Marcus and his coworkers' oral health status index described 
maowe. A number of ELindings of interest resulted from this 
exercise. 

1. Sampling Problems 

Since the same clinical cases and initial data base 

were used, the sampling problems described above will continue 
until an applicable population is sampled and a new data base 


created. 
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2. The BMDP Preference Pairs Program 

The BMDP preference pairs program [Ref. 300-301] 
appears to be a powerful statistical software program. As 
a precautionary note, however, what it does, and how it is 
accomplished, need to be understood by those using it. 

Initial outputs of BMDP preference pairs programs 
were at times confusing. As early runs were reviewed, 
particularly those runs with less than 43 variables, it was 
noted that the program had predicted zero scores for every 
clinical case for some dentists, with subsequent zero 
correlations between those dentists and all other dentists, 
including themselves. 

Further examination of the output printouts, however, 
revealed several consistent findings in these situations. 

First, the model developed for each dentist (producing 
zero scores and correlations) through the multiple regression 
phase of the preference pairs program consistently had only 
one variable. Although the variable could be any of the 
possibilities for that particular set (206, 43, 25)0se0 
variables), there was only one variable in the final step 
(always the first step). 

Second, for every case within the data base, scores 
based on those particular dentists' judgments were always 
zero. 

Third, correlations between case scores were always 
zero for any clinical case which involved that partreulas 
denerst: 
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Cases were also found, however, that revealed the 
first finding (only one variable), but failed to produce the 
problems encountered within the second and third findings 
(zero scores and zero correlations between scores, respectively). 

Subsequent experience with the BMDP preference pairs 
program revealed that this particular problem could be alle- 
viated by changing the t-values used within the multiple 
regression phase of the program. Default t-values for the 
program were 2.0 (TENTER = 2.0, TREMOVE = 2.0) [Ref. 300: 

p- 553] but were capable of being altered as desired. 

Subsequent runs of the program included t-values of 
oe -.0,' and 0.0 (TENTER = 2.0, 1.0', “and 0.0; TREMOVE = 2.0, 
1.0, and 0.0) and provided more interesting results. Since 
the final model, containing seven variables, was of primary 
mnterest in development of the index, all three runs of the 
preference pairs program (TENTER-, TREMOVE-values 0.0, 1.0, 
and 2.0) were provided in Appendices I, J, and K, respectively. 

The effects of altering the t-values (TENTER, TREMOVE) 
within the BMDP preference pairs program can be seen by 
examining Appendices I, J, and K. As can be seen, multiple 
eerects resulted. 

As the t-values (TENTER, TREMOVE) were increased from 
oo co 2.0, the number of steps, and consequently the number 
of variables, within the multiple regression portion of the 
program generally decreased. 

On the other hand, as the t-values (TENTER, TREMOVE) 


were increased from 0.0 to 2.0, the R-squared values generally, 
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but not always, decreased. Of particular interest, the two 
dentists (judges 2 and 5) for whom the preference pairs 
program yielded zero correlations when the t-values (TENTER, 
TREMOVE) were 2.0, revealed decreased R-squared values when 
the t-values (TENTER, TREMOVE) were increased from 0.0 to 1.0, 
but increased R-squared values when the t-values (TENTER, 
TREMOVE) were increased from 1.0 to 2.0. 

At a minimum, these findings should encourage at least 
some caution in interpreting and comparing findings from 
different regression models, or even the same regression 
model under different levels of significance, evaluated 
through the BMDP preference pairs program. As noted above, 
this should be particularly true of t-values (B/SEB), R-squared 


values, and correlations of dentists" case scores. 


C. DEVELOPMENT OF THE MODEL 
The initial 208 variables, as originally» abstracted zom 
the clinical cases, were obviously too cumbersome to provide 
a functional oral health index. Factor analysis, as described 
in the previous chapter, provided a means of grouping certain 
of these variables into factors (groups of variables) which 
seemed to provide the greatest explanatory power for the | 
dentists' preferences. This procedure was utilized successive- 
ly for reductions from 208 variables, to 43 variables (factors), 
to 14 variables (factors) and to seven variables (factors). 
The results of the factor analyses seemed to be rational 


from a clinical diagnostic point of view as well as from a 


a 
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statistical point of view. For example, the initial factor 
analysis procedure (on 208 variables) revealed that the 
greatest explanation for the dentists' preference could be 
obtained by using only the total number (the sum of the 
positional variables) of teeth involved within each clinical 
variable, a fact that seemed to make clinical sense, particu- 
larly when one viewed the somewhat confusing Beta-coefficients 
for the positional variables obtained earlier (with 208 
variables) from the BMDP preference pairs program. 
Additionally, as the number of variables (factors) were 
further reduced to 43, 14, and finally seven variables 
feaetors), the “gqrotipings” continued "to be rational froma 
clinical diagnostic point of view as well as a statistical 
Borne Of view. For example, the decay variable ultimately 
came to include the totals of fractured teeth (mild, severe, 
and periapical), virgin decay (mild, severe, and pulpal), 
recurrent decay (mild, severe, and pulpal), defective fillings, 
defective restorations, and defective endodontics, combinations 
which seemed to be appropriate clinically. This was true for 
all of the seven variables (factors) within the final model. 
MeEecove=:, Other Statistics Of interest revealed expected 
movement as the number of variables (factors) were reduced 
from 208, through 43 and 14, to seven. First, the t-values 
(B/SEB) of each of the variables (factors) increased as the 
number of variables decreased. Second, the R-squared values 


decreased concomitantly with the decrease in the number of 
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independent variables within each regression model. 
[Ref. 299: p. 78] | 

Lastly, the Beta-coefficients of all seven variables 
(factors) in the final model seemed intuitively and Clinieaume 
appropriate. The Beta-coefficients of all variables were 
appropriate in direction in regard to oral health status, 
with missing teeth, decayed teeth, and abnormal periodontal 
pocket depths (0-3.9 mm, 4-5.9 mm, and 6+ mm) negatively 
related to oral health, and replaced teeth, positively 2etacea 


to oral health. 


D. DEVELOPMENT OF THE INDEX 

As noted in the previous chapter, the final model developed, 
with its seven variables (factors), provided the basis for the 
oral health status index. This oral health status index, with 
its variables and Beta-coefficients, was provided within Table 
2: 

Interestingly enough, with one exception, the variables 
included within the oral health status index were the same 
as those selected by Marcus et al. As can be seen by examining 
the data within Table 15, which compares the final oral health 
status index developed by Marcus and his coworkers with that 
developed within this thesis, with the single exception of 
periodontal pockets, 2-3.9 mm, the variables included are the 
same. The Beta-coefficients of these variables, however, differ 


Signa facanitly. 
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TABLE 15 
COMPARISON OF ORAL HEALTH STATUS INDEXES 


DEVELOPED BY MARCUS ET AL. AND WITHIN 
THIS THESIS. 


Beta-Coefficients 

Variable Name Marcus et al. Thesis 
Missing Teeth and 

Free Ends -3.13 -3.28 
Decayed Teeth Sabo 7/9) =OrL5 
Replaced Teeth +0.61 +1.34 
Periodontal Pockets, 

Z=seo mms — iS "= ~"s==s== -1.97 
Periodontal Pockets, 

4-5.9 mm -0.73 -2.33 
Periodontal Pockets, 

6+ mm -3.02 -3.45 


at 


*Not included in the oral health status index of Marcus et al. 
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With the obvious differences, as noted within the 
previous chapter, in the use of statistical procedures by \ 
Marcus and his coworkers and as used within this thesis, 
this finding was not unexpected. Neither was it easily 
explained, however. The differences were manifold and 


comparisons may be of limited value. 


E. SUMMARY OF CONCLUSIONS 

First, the oral health status index, as developed by 
Marcus and his coworkers should not be applied to the general 
population served by the health benefits program of the 
uniformed services. 

Second, the BMDP preference pairs program is a powerful 
statistical, tool... If, used thoughtfully,» this, programme 
capable of developing a mathematical model, revealing the 
importance (statistical weight) attributed to each diagnostic 
variable within the model, as pairs of clinical cases are 
assessed to determine their relative levels of oral health. 

Third, using the output of the BMDP preference pairs 
program, and a carefully selected population sample, it is 
possible to develop an oral health status index that is 
valid and meaningful for the general population served by 
the health benefits program of the uniformed services. 

Fourth, an oral health index, developed for use within 
the uniformed services, can be a powerful tool in evaluating 
unmet needs of eligible benficiaries; assessing the quality 


of care provided to beneficiaries; determining the effectiveness, 
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efficiency, and productivity of providers in providing care 
to beneficiaries; determining optimal allocation of limited 
health care resources; and in accomplishing a wide range of 
health care planning activities, including manpower, resource, 
and budgetary. 

There remains, however, essential work to be done. With 
this in mind, recommendations for future endeavors in 
developing an oral health status index are addressed within 


the following chapter. 
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VI. RECOMMENDATIONS 


A. CONTINUE DEVELOPMENT OF ORAL HEALTH INDEX 

Further work on development of an oral health index, 
applicable to the health benefits program of the uniformed 
services, should be continued. “In particular, populacrams 
of health care providers, managers, planners, and other 
decision makers, as well as patients, which reflect the 
constituency. of the health benefits program supported hy 
the Navy need to be sampled adequately to provide a basis 
for subsequent research and development of an oral health 


index. 


B. EXPAND THE SCOPE OF THE ORAL HEALTH INDEX 

The development of the oral health index should be 
expanded in scope, to include not only the emphasis and 
priorities of clinical dentists, but to include the prveeteee 
and concerns of health care managers, planners, and other 
decision makers as well. 

To be successful in evaluating health care system Coneeems 
such as effectiveness, efficiency, and productivity, an oral 
health index must reflect the values of all significant health 
care professionals within the health care system, including 
health care providers, managers, planners, and other decision 


makers. 
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For example, the assessment of oral health and treatment 
needs by health care providers may be a function of the 
Clinical status of oral tissues and structures, general 
physical health, presence of specific pathologic entities, 
meegnosis, @ege, Sex, race, social status, etc., of the patient. 
The assessment of oral health and treatment needs by managers, 
planners, and other decision makers, however, may also involve 
such factors as the level of needs within the population of 
interest, the cost of various treatment alternatives, the 
resources available to cope with such alternatives, current 


laws and regulations pertaining to the provision of care, etc. 


C. EVALUATE METHODOLOGIES USED IN DEVELOPMENT OF INDEXES 

A number of basic concerns regarding methodologies 
employed in the development of oral health indexes need to 
be nesolved. 

The manner in which clinical data and information are 
presented to health care experts needs to be evaluated 
further. There are a number of experimental effects that 
may occur as a result of the experimental methodology itself, 
and where these occur, they need to be identified. A few 
of the major questions to be addressed include the following: 

What are the effects of providing photographs and histori- 
Geamedata of patients, from which the sex, race, age, and other 
social and demographic characteristics may be ascertained, on 


the assessment of oral health. 
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Do health care providers, managers, planners, and 
decision makers give greater importance to certain clinical 
conditions when they are found within some demographic groups 
than when they are found in others? 

Are certain clinical oral conditions given greater 
Significance when they occur within certain occupational 
groups, such as aviators or divers, than when they occur 
within the general population? 

Are, or should, different beneficiary groups, such as 
active military, retired military, or dependent personnel, be 
evaluated differently in regard to oral health and significance 


of oral pathology than are other categories of beneficiaries? 


Di EVALUATE DECISION MODELS OF HEALTH CARE PROFESSIONALS 

Additional research needs to be accomplished to more 
fully understand the decision making models used by health 
care providers, managers, planners, and decision makers. 

Do dental care providers, for example, base severity of 
decay on the total number of teeth affected with carious 
lesions, the ratio of decayed teeth to the total number of 
teeth present within a patient's mouth, the location of the 
decayed teeth within the patient's mouth, or some other 
model of clinical assessment. 

How do health care praviders, managers, planners, and 
decision makers measure effectiveness, efficiency, and | 
productivity within the health care system? What are the 


variables of importance? The change in the overall health 
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of the individual; the change in the overall health status 
of a beneficary population; the number of patients treated; 
the number of procedures accomplished; the resources utilized; 


ee some other factor or group of factors? 


E. EVALUATE ALTERNATIVE METHODOLOGIES 

Alternative methodologies, such as expert systems should 
be evaluated for their applicability in developing models of 
the decision making processes of health care providers, 


managers, planners, and other decision makers. 


LOW 


NOPE 
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Appendix C 


RESULTS OF PREFERENCE PAIRS PROGRAM, 


208 VARIABLES. 





PREFERENCE NAME=JUDGE1 


COEFFICIENTS OF LINEAR FUNCTIONS OF VARIABLES. 
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SCORES BASED ON JUDGMENTS EVALUATED FOR EACH CASE. 
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